Goto

Collaborating Authors

 competitive player


Evaluating Creativity and Deception in Large Language Models: A Simulation Framework for Multi-Agent Balderdash

Hejabi, Parsa, Rahmati, Elnaz, Ziabari, Alireza S., Golazizian, Preni, Thomason, Jesse, Dehghani, Morteza

arXiv.org Artificial Intelligence

Large Language Models (LLMs) have shown impressive capabilities in complex tasks and interactive environments, yet their creativity remains underexplored. This paper introduces a simulation framework utilizing the game Balderdash to evaluate both the creativity and logical reasoning of LLMs. In Balderdash, players generate fictitious definitions for obscure terms to deceive others while identifying correct definitions. Our framework enables multiple LLM agents to participate in this game, assessing their ability to produce plausible definitions and strategize based on game rules and history. We implemented a centralized game engine featuring various LLMs as participants and a judge LLM to evaluate semantic equivalence. Through a series of experiments, we analyzed the performance of different LLMs, examining metrics such as True Definition Ratio, Deception Ratio, and Correct Guess Ratio. The results provide insights into the creative and deceptive capabilities of LLMs, highlighting their strengths and areas for improvement. Specifically, the study reveals that infrequent vocabulary in LLMs' input leads to poor reasoning on game rules and historical context (https://github.com/ParsaHejabi/Simulation-Framework-for-Multi-Agent-Balderdash).


'Splatoon 3' breaks Nintendo's streak of shunning competitive players

Washington Post - Technology News

I feel like for some reason people like to try to pin [its sameness] on Splatoon in ways that they don't try to pin it on other games of a similar genre.


Why do we love puzzles like Wordle, and are they good for our brains?

PBS NewsHour

In recent weeks, a web-based word puzzle called Wordle has become a popular daily distraction. Suddenly, millions of people are focused on their vocabulary of five-letter words, and are newly aware of concepts like letter frequency and letter position as they strategize about the best opening words and faster solutions. For these people, Wordle is captivating. Previous research can help us understand how our brains respond to word games, and why we love them. Wordle is a single-player puzzle that combines elements of several games, including Scrabble and Battleship.